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OBJECf IVE — To characterize the costs and cost-effectiveness of a telephonic behavioral in- 
tervention to promote glycemic control in the Improving Diabetes Outcomes study. 

RESEARCH DESIGN AND METHODS— Using the provider perspective and a time 
horizon to the end of the 1-year intervention, we calculate the costs of a telephonic intervention 
by health educators compared with an active control (print) intervention to improve glycemic 
control in adults with type 2 diabetes. We calculate the cost-effectiveness ratios for a reduction of 
one percentage point in hemoglobin A lc (A1C), as well as for one participant to achieve an A1C 
<7%. Base-case and sensitivity analysis results are presented. 

RESULTS — The intervention cost $176.61 per person randomized to the telephone group to 
achieve a mean 0.36 percentage point of A1C improvement. The incremental cost-effectiveness 
ratio was $490.58 per incremental percentage point of A1C improvement and $2,617.35 per 
person over a 1-year intervention in achieving the A1C goal. In probabilistic sensitivity analysis, 
the median (interquartile range) of per capita cost, cost per percentage point reduction in A1C, 
and cost per person achieving the A1C goal of <7% are $175.82 (147.32-203.56), $487.75 
(356.50-718.32), and $2,312.88 (1,785.58-3,220.78), respectively. 

CONCLUSIONS — The costs of a telephonic intervention for diabetes self-management sup- 
port are moderate and commensurate to the modest associated improvement in glycemic control. 



The goal for glycemic control for most 
individuals with type 2 diabetes is a 
hemoglobin A lc (A1C) of <7% (1); 
however, more than 40% of individuals 
with diabetes in the U.S. do not reach this 
goal (2). Implementation of a diabetes 
management plan should include clinical 
care, diabetes self-management education, 
and ongoing support (1). Most individuals 
with diabetes report lack of or access chal- 
lenges for receiving diabetes self-management 
education or support (3,4). Several 
studies have reported self-management 
education and support delivered in the 
community by community peer educators 
(5,6), by Web-based applications (7), or 
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by telephone (8,9). A telephonic interven- 
tion delivered by health educators was suc- 
cessful for a poor, urban, bilingual diabetes 
population for a single behavior, such as 
going for a dilated eye examination for ret- 
inopathy screening (10), and at a moderate 
cost (11). This telephonic behavioral coun- 
seling intervention was broadened in the 
Improving Diabetes Outcomes (I DO) 
study to promote change in multiple be- 
haviors, including medication adherence, 
healthy eating, and increased physical ac- 
tivity (12,13). Information about the costs 
of such an intervention is necessary for 
knowledgeable translation of the interven- 
tion to the broad community. 



RESEARCH DESIGN AND 
METHODS— The I DO study was a 
randomized controlled trial of a behav- 
ioral telephonic intervention delivered by 
health educators with improvement in 
glycemic control as the primary outcome 
in adults with type 2 diabetes. All ran- 
domized participants received selected 
diabetes self-management print materials 
in English or Spanish, as requested (12). 
The telephonic intervention successfully 
led to a significantly greater decrease in 
A1C compared with the active control 
(print) group (13). I DO study baseline 
data and methods (12) and main results 
(13) have been published previously. In 
summary, these 526 lower-income, urban 
adults with type 2 diabetes and a baseline 
A1C >7.5%, were members/spouses in a 
health care workers' union; as such, they 
received full health care coverage, includ- 
ing medications. They were 62% non- 
Hispanic black and 23% Hispanic, and 
77% were foreign-born. Those random- 
ized to the telephone group (rt = 262) 
were assigned to a health educator for 
up to 10 self-management support phone 
calls to discuss self-management as found 
in the print materials mailed to them. 
Those randomized to the print group 
(n = 264) received only the print materi- 
als. At the end of the 1-year intervention, 
the primary outcome, change in A1C, 
showed a mean (95% CI) decrease of 
0.36% (0.02-0.69) more in the telephone 
group than in the print group (P = 0.04). 
Adjusted for baseline A1C, the mean re- 
duction in A1C for the telephone group 
compared with the print group was 
0.42% (0.11-0.73; P = 0.008). 

Here we present a cost accounting 
and cost-effectiveness analysis of that in- 
tervention. Our perspective is that of a 
provider of health services, and our time 
horizon is the duration of the intervention 
of up to 1 year. Because all costs and 
effects occurred within 1 year, no dis- 
counting was applied in these analyses. 
The telephonic intervention group re- 
ceived up to 10 telephone calls from a 
health educator, one call every 4-6 weeks, 
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in addition to the same print diabetes self- 
management education materials that 
were sent to the print (active control) 
group. Therefore, the incremental costs 
for the telephone group are those associ- 
ated with the telephonic intervention it- 
self. These costs are characterized as labor 
costs for the health educators making the 
telephone calls, labor costs for the super- 
vision and training of the health educators 
by a nurse diabetes educator, and direct 
telephone use charges. 

The labor of the health educators 
consisted of several components: time 
spent on attempted and completed tele- 
phone calls, record review and prepara- 
tion in advance of each call, and 
documentation after completed calls. Av- 
erage completed call time per person was 
abstracted from electronic study work 
logs that noted the start and end time of 
each call. The number of incomplete call 
attempts was estimated from a random 
sample and stratified on the number of 
completed calls, based on paper work 
logs recording this activity. All completed 
calls and incomplete call attempts were 
assumed to require an additional 5 min of 
record review and preparation before 
each call. Record updating after com- 
pleted calls was assumed to require yet 
another 5 min. These times were esti- 
mated by consensus of the health educa- 
tors and their nurse supervisor as being 
representative across participants. 

The health educators, by study de- 
sign, were not certified or licensed health 
professionals. They were college- 
educated community members who 
were trained for ~2 weeks by the super- 
visory nurse, who was a certified diabetes 
educator in diabetes self-management 
support and counseling skills as well as 
in the skills needed to monitor a research 
protocol and collect accurate data. They 
were supervised daily and had continu- 
ing education by weekly case manage- 
ment in counseling skills and study 
protocol. The main emphases for sub- 
jects' behavior change during the tele- 
phone calls were diabetes medication 
adherence, healthy eating, and increasing 
physical activity to improve diabetes con- 
trol (12,13). 

We identified average U.S. wages for 
these health educators and for their nurse 
supervisor from the on-line database of 
the U.S. Department of Labor's Bureau of 
Labor Statistics' National Compensation 
Survey for 2009 (the latest year available) 
(14). For our base-case analysis, the labor 
of the health educators (level 7) was 



evaluated at $18.26/h plus 28% fringe 
benefits. Supervisor time for training 
and supervision was estimated as 1 h for 
each 20 h of health educator time. Super- 
visor wages were estimated as $41.41/h 
(level 10 nurse health educator) plus 
28% fringe benefits. Telephone charges 
were estimated at $0.05 for each call ini- 
tiated (whether completed or not) plus 
$0. 10/min for completed calls. Total costs 
were computed as the sum of labor and 
telephone costs. 

Two measures of health effect were 
used for the cost analyses: J) the mean 
decrease in A1C measurement between 
the beginning and end of the intervention 
period and 2) the proportion of partic- 
ipants achieving a target A1C value 
of <7% (A1C goal). Incremental cost- 
effectiveness ratios (ICERs) for each of 
these effects were calculated using the 
standard formula: ICER = [telephone 
group total costs - print group total 
costs]/[telephone group outcome - print 
group outcome] (15). 

To assess the effect of uncertainty in 
our assumptions, we performed one-way 
and probabilistic sensitivity analyses, en- 
abling us to estimate the effects of all of 
the uncertain assumptions on our find- 
ings. For the one-way sensitivity analyses, 
parameters that were estimated from data 
gathered in the study were ranged over 
their 95% CIs. Parameters that were as- 
sumptions were allowed to vary ±50% 
from their baseline values. Wage param- 
eters, which were extracted from a national 
database, were varied between 80 and 
125% of their baseline values. 

In the probabilistic sensitivity analy- 
sis, uncertainty about the number tele- 
phone calls, call attempts made, and 
health effects was captured through boot- 
strap resampling of the study database 
(16). Uncertainty in wage rates for health 
educators and nurse supervisors was 
modeled by a bivariate normal distribu- 
tion with means equal to base-case values, 
SDs of $2 and $4 per hour, respectively, 
and a correlation coefficient of 0.14. With 
these SD, the upper and lower limits used 
in the one-way sensitivity analyses of 
wages were close to the 5th and 95th 
percentiles of the distributions in the 
probabilistic sensitivity analysis. The cor- 
relation coefficient of 0.14 was calculated 
from data on U.S. wages for a variety 
of jobs over time (17). Other than these 
wages, all parameters were sampled inde- 
pendently. We simulated 10,000 replica- 
tions of the I DO study, each with its 
own cost components and effects drawn 



from these distributions, calculated 
the corresponding total costs and 
cost-effectiveness ratios, and tracked 
the resulting distributions of costs, effects, 
and cost-effectiveness ratios. 

Our cost model is simple accounting 
of costs over a short-term period, so no 
models of asset depreciation or the like 
were required. Our health outcomes are 
taken from one randomized controlled 
trial, so no synthesis of diverse epidemi- 
ologic and clinical studies needed to be 
modeled. Owing to the simplicity and 
transparency of this model, we did not 
investigate the sensitivity of the ICERs to 
model structure. 

RESULTS 

Base case 

On average, each telephone group partic- 
ipant received 7.9 (SEM, 0.1) completed 
telephone calls, encompassing 112.7 
(7.9) minutes of contact time. In addition, 
an average of 36.9 (4.0) incomplete call 
attempts (for up to 10 intervention calls 
by protocol) per person were made; these 
included additional contact numbers and 
cellular telephones. Applying the factors 
above, telephone charges averaged 
$13.51 per person, educator labor costs 
averaged $146.49 per person, and super- 
visory labor costs averaged $16.61 per 
person. Incremental costs per person for 
the telephonic intervention were $176.61. 
The print intervention, also given to the 
telephone group, cost $4.00 per person 
for the educational materials, postage, 
and handling. Thus, the total cost of the 
intervention for the telephone group was 
$180.61 per person. 

As reported by Walker et al. (13), the 
mean difference in A1C change between 
the telephone and print groups was 0.36 
percentage points of A1C. Therefore, as- 
suming the mean cost per fractional A1C 
percentage point can be linearly extrapo- 
lated, the ICER is $490.58 per percentage 
point in A1C improvement. 

The study eligibility criterion was 
A1C >7.5%, and mean preintervention 
A1C was 9.2%. In the telephone group, 
11.8% of the 228 participants attained 
A1C <7% at the end of the study, 
whereas only 5.1% of 216 print group 
participants did so. Thus, the interven- 
tion resulted in 1 additional person with 
A1C <7% for every 15 people receiving 
it. With a per capita intervention cost 
over the print group of $176.61, the 
ICER is $2,617.35 per additional person 
achieving the A1C goal. 
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Sensitivity analyses 

The results of one-way sensitivity analy- 
ses are reported in Table 1 . Most of the 
parameter changes do not materially 
modify the ICERs. Of the resources 
used for the intervention, the ICERs are 
most sensitive to the amount of time 
spent reviewing records before calling 
patients. This reflects that this effort 
must be made even before an incomplete 
call attempt and is often repeated, prob- 
ably contributing little or nothing to 
the health outcome. By contrast, time re- 
quired to make record notes after calls is 
incurred only after a completed call, so 
the time needed for each such activity 
has much less impact on study costs. 
The parameters that most affect cost- 
effectiveness ratios, however, are not pro- 
gram resources but the actual health 
effects achieved. The great sensitivity of 
the cost-effectiveness ratio to outcome re- 
flects the range of uncertainty in study 
outcomes themselves, particularly for 
the number needed to treat to achieve 
the AlC goal. It should be born in mind 
that the average effect of any intervention 
targeting AlC is likely to be of the order 
of magnitude of ^1%, so that attaining 
the AlC goal is unlikely for people start- 
ing out with AlC of >9%. With -40% of 
our participants having a baseline AlC 



&9%, the proportion who achieved the 
goal in either group was, as already noted, 
fairly small, so that the group difference 
(and, hence, its reciprocal, the number 
needed to treat) is estimated with limited 
precision in a study this size. 

The probabilistic sensitivity analysis 
gives a more comprehensive picture of the 
uncertainty of the ICERs because it takes 
into account the uncertainty of all of the 
assumptions about the parameters while 
still properly representing the low prob- 
ability that several parameters will simul- 
taneously take on extreme values. Table 2 
provides key percentiles of the simulated 
distributions of I DO effects, costs, and 
cost-to-effectiveness ratios. The median 
ICER of $487.75 for change in AlC and 
$2,312.88 for those who achieved the 
AlC goal are close to the base-case ICERs, 
as expected. In 90% of replications, the 
ICER for change in AlC falls between 
the 5th and 95th percentiles, to wit 
$243.18 and $1,772.55, and the ICER 
for persons achieving the AlC goal, be- 
tween $1,277.75 and $6,090.40. In addi- 
tion, we note that in 1.8% of the 
simulated study replications, the print 
group achieved lower mean AlC levels 
than the telephone group, and in 0.4% 
the print group achieved a higher rate of 
achieving the AlC goal. 



Decision makers may have threshold 
values for the ICER, below which they 
consider an intervention acceptable. In 
the current situation, if a decision maker's 
threshold were, say, $1,000 per percent- 
age point improvement in AlC, we see 
from Table 2 that the probability that our 
intervention meets that cost-effectiveness 
limit is close to 90%. (The actual probability 
is 87%.) 

CONCLUSIONS— We have found 
that the incremental per capita costs of 
the telephonic intervention, $176.61, 
were modest. Each additional percentage 
point reduction in AlC and each addi- 
tional person attaining the AlC goal of 
<7% cost, respectively, $490.58, and 
$2,617.35. The cost-effectiveness ratios 
are robust to most of our assumptions in 
sensitivity analysis. The largest single 
source of uncertainty was the CI around 
the actual AlC effect observed in the trial. 
Even in probabilistic sensitivity analysis, 
where all uncertain assumptions vary si- 
multaneously, the 95th percentile ICER 
exceeds the base-case estimate only by 
approximately a factor of two. Our find- 
ings supplement the earlier report of the 
clinical effectiveness of the I DO tele- 
phonic (13) intervention with estimates 
of its cost and cost-effectiveness. 



Table 1 — One-way sensitivity analyses 











CER ($) 


Parameter 


Base-case value 


Basis for alternative 


Alternative value 


AlC* 


At goalf 


Total call time per person (mm) 


112.74 


Lower 95% CL 


106.56 


481.42 


2,568.46 






Upper 95% CL 


118.92 


499.74 


2,666.23 


Incomplete calls per person 


36.94 


Lower 95% CL 


28.9 


441.03 


2,353.00 






Upper 95% CL 


45 


540.25 


2,882.35 


Telephone cost per minute ($) 


0.1 


50% less 


0.05 


474.92 


2,533.81 






50% more 


0.15 


506.24 


2,700.89 


Record review time pre-call (min) 


5 


50% less 


2.5 


355.65 


1,897.44 






50% more 


7.5 


625.52 


3,337.25 


Post-call charting time (min) 


5 


50% less 


2.5 


466.91 


2,491.04 














Supervision time as proportion of work 


0.05 


50% less 


0.025 


467.51 


2,494.27 




Wages ($/h) 


Educator 


18.26 


80% base 


14.61 


400.02 


2,134.18 


Educator 
Supervisor 




125% base 


22.83 
51.76 


603.95 


3,222.19 


AlC benefit (% AlC) 


0.4 


Lower 95% CL 


0.22 


802.77 


N/A 






Upper 95% CL 


0.49 


360.43 


N/A 






Lower 95% CL 


8.4 




1,483.52 






Upper 95% CL 


61.3 


N/A 


10,826.14 



CL, confidence limit; N/A, not applicable. "Cost per percentage point decrease in AlC. tCost per additional person with AlC <7.0%. 



2158 



Diabetes Care, volume 35, November 2012 



care . diabet esj ournals . org 



Schechter and Associates 



Table 2 — Probabilistic sensitivity analysis 





A mean A1C 


A % at A1C 


goal 


Costs/person 


ICER 
















$/person 


Percentile 


Telephone - 


print Telephone - 


print 


$ 


$/A A1C 


achieving goal 


5th 


0.08 




2.84 




122.82 


243.18 


1,277.75 


10 th 


0.14 




3.85 




130.79 


279.06 


1,441.08 


25 th 


0.24 




5.60 




147.32 


356.50 


1,785.58 


50 th (median) 


0.36 




7.57 




175.82 


487.75 


2,312.88 


75th 


0.47 




9.47 




203.56 


718.32 


3,220.78 












224.14 


1,160.07 


4,630.02 


95th 


0.63 




12.20 




234.79 


1,772.55 


6,090.40 



This Table shows key percentiles of the intervention effects, costs, and cost-effectiveness ratios found 
in 10,000 simulated replications of the study. 



Studies of behavioral interventions to 
improve glycemic control have had vary- 
ing results. For example, Frosch et al. (18) 
tested an intervention consisting of an edu- 
cational DVD and booklet combined 
with up to 2.5 h of telephonic coaching 
and motivational enhancement by a nurse 
educator over 6 months. A control group 
received a diabetes self-management bro- 
chure developed by the National Diabetes 
Education Program. Of recent reported 
studies, their intervention is most similar 
to ours. At the end of 6 months, both 
groups showed substantial improvement 
in A1C, but the improvements in A1C in 
the two groups were similar (—0.5% A1C) 
and the difference was not statistically sig- 
nificant (18). Our findings may differ be- 
cause of differences in A1C inclusion 
criteria (>8% A1C vs. >7.5% in the 
I DO study), length of the intervention (6 
vs. 12 months in the 1 DO study), counsel- 
ing techniques, or details of intervention 
implementation. There was no cost analysis 
associated with their study. 

For simplicity, we framed one of our 
effectiveness outcomes as cost per percent- 
age point reduction in A1C. The observed 
difference in mean A1C change between 
groups in our study, however, was 0.36 
percentage points. One might, therefore, 
denominate the cost-effectiveness ratio in 
this unit of change: $176.61 per 0.36 
percentage point A1C improvement, as a 
full percentage point improvement in A1C 
was not, on average, achieved with this 
intervention. We do not know whether or 
how this modality of intervention might be 
amplified to achieve that average level of 
improvement in glycemic control or 
whether the costs per fractional percentage 
point in A1C improvement can be linearly 
extrapolated. 

Cost-effectiveness ratios are readily 
used to compare different interventions 



that produce the same outcome. The ICER 
then becomes, in effect, a unit price, a 
measure of value for money. There is 
no broadly accepted threshold of cost- 
effectiveness per unit of change in A1C or 
per person achieving Al C ^ 7% , but we can 
compare our findings with other studies 
that have calculated cost-effectiveness ratios 
in these units. 

Overall, our costs per person are 
moderate, as are the costs per percentage 
point reduction in A1C and per person 
achieving A1C goal. For comparison, 
Patel et al. (19) studied motivational en- 
hancement and cognitive behavioral 
therapy delivered by nurses trained in 
these techniques to improve outcomes 
in patients with diabetes in the U.K. 
The combination of those two interven- 
tions reduced A1C by 0.45 percentage 
points, a somewhat larger effect than 
we obtained. But the cost-effectiveness 
ratio was £1,765 ($2,824 at current ex- 
change rates) per percentage point of 
A1C reduction (19), making our inter- 
vention far more cost-effective than 
theirs. Another recently published study 
reported the cost evaluation of a diabetes 
self-management intervention for La- 
tinas (20) that was considerably more in- 
tensive (including in-person visits and 
counseling from licensed health care 
professionals) than the I DO study. It 
was also a little more costly per capita, 
$184 per person in the in-person treat- 
ment group. The health effect they tar- 
geted was increased consumption of fruits 
and vegetables, not change in A1C. 
Accordingly, their cost-effectiveness ra- 
tios are not directly comparable with 
ours. The authors, however, included 
recommendations to consider using the 
telephone as a means to maintain effec- 
tiveness, reduce costs, and increase the 
reach of a self-management support 



program to many more who might bene- 
fit from it (20). 

We believe that the use of health 
educators, not trained as clinicians, in 
our intervention restrained the cost of our 
program, while the continuing education 
and rigorous supervision by a nurse di- 
abetes educator bolstered the quality and 
effectiveness of the intervention. 

Our study has several limitations. 
First, we do not know how long the 
effects of the I DO telephonic intervention 
persist; continuing phone contact or in- 
termittent "boosters" might be required to 
sustain the improvements achieved. Ac- 
cess to follow-up A1C data for all study 
participants or to intervene after the 
1-year intervention was outside the scope 
of our study. Accordingly, we restricted 
the time horizon of our analysis to the 
intervention period itself and cannot esti- 
mate cost-utility ratios based on quality- 
adjusted life-years. Research on the 
durability of the intervention effect and 
long-term health outcomes would facilitate 
cost-utility analysis. 

Second, the optimal implementation 
of interventions like ours is not known. A 
briefer intervention with fewer calls might 
have achieved much of the benefit we 
realized, or a longer intervention might 
have promoted behavior change for some 
of the participants who did not benefit 
during the 1-year intervention. Our study 
and analysis shed no light on these pos- 
sible improvements or their economic 
implications; further data are necessary 
to resolve those questions. 

A third limitation is the generalizabil- 
ity of our study sample. Although partic- 
ipants were lower-income with racial and 
ethnic diversity, they did all have the 
benefit of health care coverage by virtue of 
their employment and union benefits. 

Our perspective is that of a health care 
organization providing services to these 
patients: during the study we did not 
collect information about intervention- 
related time, effort, expenses incurred by 
the participants and their families and 
caregivers, or health services utilization. 

Our cost estimates exclude supplies, 
office space for intervention personnel, 
and storage space for records because we 
believe this type of intervention would 
normally be implemented using existing 
staff and facilities. For the same reason, 
we did not include start-up costs, such as 
staff recruitment, in our analysis. Protocol 
development time in a nonresearch con- 
text is difficult to estimate, but we be- 
lieve it would be small; and as a one-time, 
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up-front cost, when allocated over all 
patients, we think it would be trivial. 
Implementation of the intervention does 
not require development or special main- 
tenance of any data systems that would 
not already be operational in a health care 
setting, so we allocated no costs for this. 

Following standard practice of re- 
porting ICERs, we did not include the 
cost of the print materials and postage that 
were common to both study arms in our 
cost-effectiveness ratio calculations. At $4 
per person, this would be an additional 
cost to a provider implementing this in- 
tervention in settings with nothing similar 
to the print intervention already in place. 
In that situation, the simultaneous imple- 
mentation of two interventions might lead 
to improvement in glycemic control differ- 
ent from what was observed in our study. 
The I DO study did not include a no- 
intervention (control) group, for ethical 
reasons, because diabetes self-management 
education is a standard of care (1,3), and 
because most providers of diabetes care al- 
ready furnish print materials or access to 
on-line resources similar to our print ma- 
terials. Accordingly, although we have re- 
ported the total cost along with the 
incremental cost, we can estimate neither 
an effect nor a cost-effectiveness ratio for 
the simultaneous implementation of print 
and telephonic interventions in a context 
currently offering neither. 

In summary, the I DO study results 
suggest that a modest improvement in A1C 
can be achieved at a moderate cost using a 
telephonic intervention conducted by 
health educators trained and supervised 
by a nurse certified diabetes educator. 
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